User terminal device and method for controlling the user terminal device thereof

ABSTRACT

A user terminal device and a control method are provided. The user terminal device includes a display, a sensor configured to sense a user interaction on the display, and a controller configured to, in response to a user interaction being sensed by the sensor of a touch being made by an input device of a polyhedral shape that includes different touch patterns on each of a plurality of surfaces, control a function of the user terminal device according to a touch pattern on a touched surface among the plurality of surfaces.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. application Ser. No.16/013,000, filed Jun. 20, 2018 (now U.S. Pat. No. 10,372,238), which isa Continuation of U.S. application Ser. No. 15/901,956, filed Feb. 22,2018 (now U.S. Pat. No. 10,007,360), which is a Continuation of U.S.application Ser. No. 15/690,384, filed Aug. 30, 2017 (now U.S. Pat. No.9,927,885), which is a Continuation of U.S. application Ser. No.14/863,882, filed Sep. 24, 2015 (now U.S. Pat. No. 9,766,722), whichclaims priority to KR 10-2014-0130519, filed Sep. 29, 2014, the entirecontents of each of which are all hereby incorporated herein byreference. This application is also related to U.S. application Ser. No.15/718,105, filed Sep. 28, 2017 (now U.S. Pat. No. 9,880,643).

TECHNICAL FIELD

The present disclosure relates to a methods and apparatuses consistentwith the various embodiments to a user terminal device and a controlmethod thereof. More particularly, the present disclosure relates to auser terminal device that is controlled by a polyhedron-shaped inputdevice, and a control method thereof.

BACKGROUND

These days, various functions are being provided by various userterminal devices (for example, smart phones, tablet personal computers(PCs), notebooks, and PCs and the like). For example, the latest userterminal devices not only perform call functions but also other variousfunctions such as internet search functions, contents creation andediting functions, schedule managing functions, and health managingfunctions and the like.

However, these various user terminal devices increased the steps forentering menus using user touch in order to perform such variousfunctions, causing inconvenience to users according to the related art.

Furthermore, in these types of various user terminal devices, to executea new operation, a user has to use the certain screen area, also causinginconvenience of having to make multiple manipulations according to therelated art.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide a user terminal device capable of performingvarious functions by sensing an input device having different touchpatterns on each of a plurality of surfaces and a control methodthereof.

In accordance with an aspect of the present disclosure, a user terminaldevice is provided. The user terminal device includes a display, asensor configured to sense a user interaction on the display, and acontroller configured to, in response to a user interaction sensed bythe sensor of a touch being made by an input device of a polyhedralshape that includes different touch patterns on each of a plurality ofsurfaces, control a function of the user terminal device according to atouch pattern on a touched surface among the plurality of surfaces.

Each of the plurality of surfaces of the input device may have acorresponding function, and the controller may sense the touch patternon the touched surface of the input device, determine the touchedsurface based on the sensed touch pattern, and perform the functioncorresponding to the determined touched surface.

The controller, in response to a user interaction sensed by the sensorof the touch being made by the input device, may control the display todisplay a user interface (UI) that includes a plurality of menus forcontrolling the user terminal device on an area surrounding an areatouched by the input device according to the touch pattern on thetouched surface among the plurality of surfaces.

The controller, in response to a user interaction sensed by the sensorof the touch being made by the input device and then dragged to one ofthe plurality of menus while the UI including the plurality of menus isbeing displayed, may perform a function corresponding to the menu towhich the drag has been made.

The controller, in response to a drag interaction sensed by the sensorof a touch being made by a first surface among the plurality of surfacesof the input device on a first point of the display and then dragged toa second point, may control the display to create a new screen on anarea where the drag interaction is sensed.

The controller may create a new type of screen according to the sensedtouch pattern on the first surface.

The controller, in response to a turn around interaction sensed by thesensor of a touch being made by a first surface of the input device andthen by a second surface of the input device, may perform a functioncorresponding to the turn around interaction of the input device.

The user terminal device may further include a storage, wherein thecontroller, in response to a user interaction sensed by the sensor of atouch being made by a first surface of the input device and then by asecond surface of the input device, and then a tap interaction sensed bythe sensor of a first item among at least one item has been tapped bythe second surface of the input device, may store data corresponding tothe sensed first item where the tap interaction is sensed in thestorage.

The controller, in response to a rotating interaction sensed by thesensor of the input device being rotated while maintaining a touch madeby a first surface on a first item among at least one item beingdisplayed on the display, may perform a function corresponding to thefirst surface regarding the first item.

The controller, in response to a rotation interaction sensed by thesensor of the input device being rotated while maintaining a touch madeby a first surface on a first point of the user terminal device with thedisplay showing a waiting screen, may adjust a volume of the userterminal device according to the rotating interaction of the inputdevice.

In accordance with an aspect of the present disclosure, a control methodof a user terminal device is provided. The method includes sensing auser interaction of a touch being made by an input device of apolyhedral shape that includes different touch patterns on each of aplurality of surfaces, and performing a function of the user terminaldevice according to a touch pattern on a touched surface among theplurality of surfaces.

Each of the plurality of surfaces of the input device may have acorresponding function, and wherein the performing of the function ofthe user terminal device may include sensing the touch pattern on thetouched surface of the input device, determining the touched surfacebased on the sensed touch pattern, and performing the functioncorresponding to the determined touched surface.

The performing a function of the user terminal device may include, inresponse to a user interaction sensed by the sensor of the touch beingmade by the input device, controlling the display to display a UI thatincludes a plurality of menus for controlling the user terminal deviceon an area surrounding an area touched by the input device according tothe touch pattern on the touched surface among the plurality ofsurfaces.

The performing a function of the user terminal device may include, inresponse to a user interaction sensed by the sensor of the touch beingmade by the input device and then dragged to one of the plurality ofmenus while the UI including the plurality of menus is being displayed,performing a function corresponding to the menu to which the drag hasbeen made.

The performing a function of the user terminal device may include, inresponse to a drag interaction sensed by the sensor of a touch beingmade by a first surface among the plurality of surfaces of the inputdevice on a first point of the display and then dragged to a secondpoint, controlling the display to create a new screen on an area wherethe drag interaction is sensed.

The creating of the new screen may include creating a new type of screenaccording to the sensed touch pattern on the first surface.

The performing a function of the user terminal device may include, inresponse to a turn around interaction sensed by the sensor of a touchbeing made by a first surface of the input device and then by a secondsurface of the input device, performing a function corresponding to theturn around interaction of the input device.

The performing a function of the user terminal device may include, inresponse to a user interaction sensed by the sensor of a touch beingmade by a first surface of the input device and then by a second surfaceof the input device, and then a tap interaction sensed by the sensor ofa first item among at least one item has been tapped by the secondsurface of the input device, storing data corresponding to the sensedfirst item where the tap interaction is sensed in a storage of the userterminal device.

The performing a function of the user terminal device may include, inresponse to a rotating interaction sensed by the sensor of the inputdevice being rotated while maintaining a touch made by a first surfaceon a first item among at least one item being displayed on the display,performing a function corresponding to the first surface regarding thefirst item.

The performing a function of the user terminal device may include, inresponse to a rotation interaction sensed by the sensor of the inputdevice being rotated while maintaining a touch made by a first surfaceon a first point of the user terminal device with the display showing awaiting screen, adjusting a volume of the user terminal device accordingto the rotating interaction of the input device.

According to the aforementioned various embodiments of the presentdisclosure, the user terminal device may not only perform variousmanipulations through the polyhedral shaped input device but may alsoprovide a new interaction where various fun elements have been added.Furthermore, since the polyhedral input device does not need anyadditional power, it is possible to perform various functions using theinput device where a battery is unnecessary.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a view illustrating a user terminal device and an input deviceaccording to an embodiment of the present disclosure;

FIG. 2 is a block diagram schematically illustrating a configuration ofa user terminal device according to an embodiment of the presentdisclosure;

FIG. 3 is a block diagram illustrating in detail a configuration of auser terminal device according to an embodiment of the presentdisclosure;

FIGS. 4A, 4B, 4C and 4D are views for explaining an hexahedral inputdevice according to an embodiment of the present disclosure;

FIGS. 5A to 15B are views for explaining various embodiments ofcontrolling a user terminal device using a hexahedral input deviceaccording to various embodiments of the present disclosure; and

FIG. 16 is a flowchart for explaining a method for controlling a userterminal device according to an embodiment of the present disclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

In the following description, like drawing reference numerals are usedfor the like elements, even in different drawings. The matters definedin the description, such as detailed construction and elements, areprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure. However, various embodiments ofthe present disclosure can be practiced without those specificallydefined matters. Also, well-known functions or constructions are notdescribed in detail since they would obscure the application withunnecessary detail.

Terms such as ‘first’ and ‘second’ may be used to describe variouscomponents, but they should not limit the various components. Thoseterms are only used for the purpose of differentiating a component fromother components. For example, a first component may be referred to as asecond component, and a second component may be referred to as a firstcomponent and so forth without departing from the spirit and scope ofthe present disclosure. Furthermore, ‘and/or’ may include any one of ora combination of the components mentioned.

Furthermore, a singular form may include a plural from as long as it isnot specifically mentioned in a sentence. Furthermore,“include/comprise” or “including/comprising” used in the specificationrepresents that one or more components, operations, and elements existor are added.

In the embodiments of the present disclosure, a ‘module’ or ‘unit’performs at least one function or operation, and may be realized ashardware or software, or a combination thereof. Furthermore, a pluralityof ‘modules’ or a plurality of ‘units’ may be integrated into at leastone module and be realized as at least one processor (not illustrated)except for when they need to be realized as a certain hardware.

Hereinafter, various embodiments of the present disclosure will beexplained with reference to the drawings attached. FIG. 1 is a viewillustrating a user terminal device 100 and an input device 200according to an embodiment of the present disclosure. Herein, the userterminal device 100 may be a tablet personal computer (PC) asillustrated in FIG. 1, but without limitation, and thus the userterminal device 100 may be another type of user terminal device (forexample, smart phone, notebook PC, smart TV, desktop PC, and kiosk andthe like). The input device 200 may have a polyhedral shape with aplurality of surfaces. For example, as illustrated in FIG. 1, the inputdevice 200 may have a regular hexahedral shape, but without limitation,and thus the input device 200 may have any one of various polyhedralshapes such as regular hexahedron, and regular octahedron and the like.Especially, the input device 200 may include different touch patterns ineach of the plurality of surfaces.

In a case where one of the plurality of surfaces of the input device 200touches the user terminal device 100, the user terminal device 100 maycontrol a function of the user terminal device 100 according to a touchpattern on the touched surface. Various functions that may be performedaccording to user interactions of the user terminal device 100 using theinput device 200 will be explained in further detail later on.

FIG. 2 is a block diagram schematically illustrating a configuration ofthe user terminal device 100 according to an embodiment of the presentdisclosure.

Referring to FIG. 2, the user terminal device 100 includes a display110, sensor 120, and controller 130.

The display 110 displays an image content received from outside.Especially, when the input device 200 having the polyhedral shape istouched on the display 110, the display 110 may display a user interface(UI) near the area touched by the input device 200.

The sensor 120 senses a user interaction on the display 110. Morespecifically, the sensor 120 may sense a user interaction of a touchbeing made on the display 110 by the input device 200 having thepolyhedral shape. Herein, the sensor 120 may sense different types oftouch patterns formed on each of the plurality of surfaces included inthe input device 200.

The controller 130 may control the overall operations of the userterminal device 100. Especially, when a user interaction of the inputdevice 200 touching the display 110 is sensed through the sensor 120,the controller 130 may control the functions of the user terminal deviceaccording to the touch pattern on the touched surface among theplurality of surfaces. Herein, each of the plurality of surfaces of theinput device 200 may have a corresponding function and include a shaperepresenting the corresponding function.

More specifically, when a user interaction is sensed of the display 110being touched by the input device 200 through the sensor 120, thecontroller 130 may sense a touch pattern on the touched surface of theinput device, and determine the touched surface based on the sensedtouch pattern, and perform a function corresponding to the determinedtouched surface.

In an embodiment of the present disclosure, when a user interaction of atouch by the input device 200 is sensed, the controller 130 may controlthe display 110 to display on an area surrounding the touched area bythe input device 200 a UI that includes a plurality of menus to controlthe user terminal device according to the touch pattern of the touchedsurface of the plurality of surfaces. For example, when a userinteraction of a first surface of the input device 200 touching thedisplay 110 is sensed, the controller 130 may determine the firstsurface touched based on the touch pattern of the first surface andcontrol the display 110 to display a UI that includes various menus suchas a home menu, edit menu, and search menu and the like such that itcorresponds to the first surface.

Furthermore, when an interaction is sensed of the input device 200 beingdragged to one of the plurality of menus with the input device 200 stilltouching the display, the controller 130 may perform a function thatcorresponds to the menu to which the input device 200 has been dragged.For example, when an interaction is sensed of the input device 200 beingdragged to the search menu of the plurality of menus with the inputdevice 200 still touching the display, the controller 130 may controlthe display 110 to display a search window to perform the searchfunction.

Furthermore, when an interaction is sensed of the display being touchedby to first surface of the plurality of surfaces of the input device 200and then being dragged to a second point, the controller 130 may controlthe display 110 to create a new screen on an area where the interactionwas input. Herein, the controller 130 may generate a new type of screenaccording to the touch pattern of the first surface that touched thedisplay.

Furthermore, when an interaction is sensed of the input device 200 beingturned around such that the surface touching the display is changed fromthe first surface to the second surface, the controller 130 may performa function corresponding to the interaction. For example, the controller130 may perform a function of moving an item according to theinteraction of the input device 200 being turned over.

Furthermore, after an interaction is sensed of the input device 200being turned around such that the surface touching the display ischanged from the first surface to the second surface with at least oneitem being displayed on the display 110 and then a tap interaction of afirst item of the at least one item being tapped by the second surfaceof the input device tapping, the controller 130 may store datacorresponding to the first item where the tap interaction was sensed.

Furthermore, when an interaction is sensed of the input device 200 beingrotated with the first surface of the input device 200 still touchingthe first item of the at least one item being displayed, the controllermay perform a function corresponding to the first surface on the firstitem. For example, when an interaction is sensed of the input device 200being rotated with the first surface of the input device 200 stilltouching the first item, the controller 130 may perform a lockingfunction on the first item.

According to the aforementioned various embodiments of the presentdisclosure, the user terminal device 100 may not only perform variousmanipulations through an input device having a polyhedral shape but alsoprovide a new interaction with various fun elements added thereto.

Hereinafter, the present disclosure will be explained in further detailwith reference to FIGS. 3 to 15B.

FIG. 3 is a block diagram illustrating in detail a configuration of theuser terminal device 100 according to an embodiment of the presentdisclosure. The user terminal device 100 includes a communicator 140,display 110, audio output device 150, storage 160, sensor 120, inputdevice 170 and controller 130.

Referring to FIG. 3, a comprehensive illustration of various componentsof a user terminal device that includes various functions such as acommunication function and display function for example. Therefore, inan embodiment, some of the illustrated components may be changed orother components may be further added.

The communicator 140 is a configuration for performing various types ofexternal devices or external servers according to various types ofcommunication methods. The communicator 140 may include variouscommunication chips such as a WiFi chip, Bluetooth chip, NFC chip, andwireless communication chip and the like. Herein, each of the WiFi chip,Bluetooth chip, and near field communication (NFC) chip performscommunication in the WiFi method, Bluetooth method, and NFC method,respectively. Of these chips, the NFC chip is a chip that operates in anNFC method that uses the 13.56 MHz bandwidth, among numerous RF-IDfrequency bandwidths of 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, and2.45 GHz. When using a WiFi chip or Bluetooth chip, it is possible totransceive various information on connection such as information on anSSID and session key first, make a communication connection using thoseinformation to transceive various information. A wireless communicationchip refers to a chip that performs communication according to variouscommunication standards such as IEEE, zigbee, 3^(rd) Generation, 3rdgeneration partnership project (3GPP), and long term evolution (LTE).

Especially, when a user interaction is sensed in which the input device200 including a different touch pattern in each of the plurality ofsurfaces has touched the display, the communicator 140 may establish acommunication connection with another user terminal device 100 thatsensed the same touch pattern as the touch pattern on the touchedsurface of the input device.

The display 110 displays at least one of a video frame consisting ofimage data received from an image receiver (not illustrated) processedby an image processor (not illustrated) and various screens generated ina graphic processor 133. Especially, the display 110 may display on thearea surrounding the touched area a UI that includes at least one menuthat may control the user terminal device 100.

The audio output device 150 is a component for outputting various audiodata processed in the audio processor (not illustrated), various alarmsounds, and voice messages.

The storage 160 stores various modules for driving the user terminaldevice 100. For example, a software including a base module, sensingmodule, communication module, presentation module, web browser module,and service module may be stored in the storage 160. Herein, the basemodule is a basic module that processes a signal transmitted from eachhardware included in the user terminal device 100 and transmits theprocessed signal to an upper layer module. A sensing module is a modulethat collects information from various sensors, and that analyzes andmanages the collected information. Examples of sensing modules include aface recognition module, voice recognition module, motion recognitionmodule, and NFC recognition module. The presentation module is a moduleused to configure a display screen. Examples of presentation modulesinclude a multimedia module for reproducing and outputting multimediacontents, and UI rendering module for processing a UI and graphics. Thecommunication module is a module used for communicating with an externaldevice. The web browser module is a module for web browsing andaccessing a web server. The service module is a module that includesvarious applications for providing various services.

Especially, the storage 160 may store information on the touch patternsincluded in each of the plurality of surfaces of the input device 200,and also information on the functions and UI corresponding to each ofthe plurality of surfaces.

The sensor 120 senses a user interaction on the display 110. Especially,the sensor 120 may sense various user interactions such as a touchinteraction, drag interaction, rotation interaction, turn overinteraction and the like made on the display 110. Meanwhile, the sensor120 may be configured as a touch screen just as the display 110, or oneof various types of sensing devices such as a proximity sensor, cameraand the like.

The input device 170 receives user commands for controlling overalloperations of the user terminal device 100. Especially, the input 170may be configured as a button and the like, but without limitation, andthus the input device 170 may be configured as another type of inputdevice such as a remote control, pointing device and the like that maycontrol the user terminal device 100.

The controller 130 controls the overall operation of the terminal device100 using various programs stored in the storage 160.

As illustrated in FIG. 3, the controller 130 includes a RAM 131, ROM132, graphic processor 133, main CPU 134, 1^(st) to n^(th) interfaces135-1 to 135-n, and bus 136. Herein, the RAM 131, ROM 132, graphicprocessor 133, main CPU 134, and 1^(st) to n^(th) interfaces 135-1 to135-n may be connected to one another via buses 136.

The ROM 132 stores sets of commands for system booting. When a turn oncommand is input and power is supplied, the main CPU 134 copies an O/Sstored in the storage 160 to the RAM 131 according to the command storedin the ROM 132, and executes the O/S to boot the system. When thebooting is completed, the main CPU 134 copies various applicationprograms stored in the storage 160 to the RAM 131, and executes theapplication programs copied to the RAM 131 to execute variousoperations.

The graphic processor 133 generates a screen that includes variousobjects such as icons, images and texts using an operator (notillustrated) and renderer (not illustrated). The operator computesattribute values such as coordinates, shapes, sizes, and colors and thelike of each object to be displayed according to layouts of the screenusing control commands received from the sensor 120 or input device 170.

The renderer generates screens of various layouts that include objectsbased on attribute values computed in the operator. The screen generatedin the renderer is displayed within the display area of the display 110.

The main CPU 134 accesses the storage 160, and performs booting usingthe O/S stored in the storage 160. Furthermore, the main CPU 134performs various operations using various programs, contents, and dataand the like stored in the storage 160.

The 1^(st) to n^(th) interfaces 135-1 to 135-n are connected to theaforementioned various components. One of the interfaces may be anetwork interface connected to an external device via a network.

Especially, when a user interaction of the display 110 being touched bythe input device 200 having a polyhedral shape is sensed through thesensor 120, the controller 130 may control the functions of the userterminal device 100 according to a touch pattern on the touched surfaceamong the plurality of surfaces of the input device.

According to an embodiment of the present disclosure, the input device200 having a polyhedral shape may be one having a regular hexahedralshape. Each of the plurality of surfaces of the input device 200 has itscorresponding functions of the user terminal device 100, and each of theplurality of surfaces of the input device 200 may include a shaperepresenting its functions of the user terminal device 100. For example,as illustrated in FIG. 4A, a first surface of the input device 200includes a shape representing a wireless communicating function 410-1, asecond surface of the input device 200 includes a shape representing abrightness adjustment function 410-2, a third surface of the inputdevice 200 includes a shape representing a schedule management function410-3, and a fourth surface of the input device 200 includes a shaperepresenting a search function 410-4, a fifth surface of the inputdevice 200 includes a shape representing a lock function 410-5, and asixth surface of the input device 200 may include a shape representing adata storing function 410-6. Meanwhile, besides the aforementioned,there may be other kinds of various functions (for example deletingfunction and magnet function and the like) that may correspond to eachof the plurality of surfaces of the input device 200.

Furthermore, each of the plurality of surfaces of the input device 200includes an electrode with different touch patterns.

Specifically, as illustrated in FIG. 4B, the plurality of surfaces ofthe input device 200 include electrodes 420-1 to 420-6 of differentcounts and shapes. Herein, the locations and counts of the electrodesmay be different from one another as illustrated in FIG. 4C, and theshapes of the electrodes may be different from one another asillustrated in FIG. 4D.

Meanwhile, according to an embodiment of the present disclosure, a touchpattern formed on one surface and a shape representing its function maycorrespond to each other. That is, a touch pattern 420-1 of the firstsurface may correspond to a shape of the first surface 410-1, a touchpattern 420-3 of the third surface may correspond to a shape of thethird surface 410-2, a touch pattern 420-4 of the fourth surface 410-4may correspond to a shape of the fourth surface 410-4, a touch pattern420-5 of the fifth surface may correspond to the fifth surface 410-5,and a touch pattern 420-6 of the sixth surface may correspond to a shape410-6 of the sixth surface.

However, this is a mere embodiment of the present disclosure, and thus atouch pattern of a surface may correspond to a shape of the surface onthe opposite side so that the function that the user intends to executecan be seen. More specifically, in a case where the user performs atouch interaction using the input device 200, not the touched surfacebut the opposite surface may be shown to the user. Therefore, a touchpattern may correspond to the shape on the opposite side so that theuser may see the function of the touched surface more intuitively.Therefore, a touch pattern 420-1 of the first surface may correspond toa shape 410-3 of the third surface, a touch pattern 420-2 of the secondsurface may correspond to a shape of the fifth surface 410-5, a touchpattern of the third surface may correspond to a shape 410-1 of thefirst surface, a touch pattern 420-4 of the fourth surface maycorrespond to the shape of the sixth surface 410-6, a touch pattern420-5 of the fifth surface may correspond to the shape of the secondsurface 410-2, and a touch pattern of the sixth surface may correspondto a shape of the fourth surface 410-4. In such a case, the shapeincluded in the opposite surface of the touched surface is shown to theuser, thereby enabling the user to see the functions corresponding tothe touched surface more easily.

In the aforementioned embodiments of the present disclosure, it wasexplained that the input device 200 includes an electrode of apredetermined touch pattern, and that the sensor 120 is a capacitivetouch panel, but this is not limitation thereto, and thus the sensor 120may be a decompression type touch panel, wherein the input device 200may be provided with a touch pattern on each of the plurality ofsurfaces so that pressure can be applied to the predetermined touchpattern.

Referring to FIGS. 5A to 15B, explanation will be made on variousfunctions that may be performed according to a sensed user interactionusing the input device 200.

In an embodiment of the present disclosure, when an interaction of afirst surface among the plurality of surfaces of the input device 200touching a first point on the display 110 and dragging the touch to asecond point is sensed, the controller 130 may control the display 110to generate a new screen on the area where the interaction was sensed.

Referring to FIG. 5A, when an interaction is sensed in which the firstpoint of the display 110 is touched by the first surface of the inputdevice 200 and then dragged to the second point of the display 110 asillustrated in FIG. 5B, the controller 130 may, as illustrated in FIG.5C, control the display 110 to display a new window. Herein, the newwindow may have a shape of a square where the first point and secondpoint face each other as illustrated in FIG. 5C.

Especially, the controller 130 may control the display 110 to generate anew screen 510 of a different type according to the touch pattern of thetouched first surface. For example, when the first surface is a surfacethat corresponds to the schedule managing function, the controller 130may, as illustrated in FIG. 5C, control the display 110 to display ascreen on the new screen for schedule managing. In another embodiment ofthe present disclosure, in a case where the first surface corresponds tothe search function, the controller 130 may control the display 110 todisplay a screen for search on a new screen.

Furthermore, when an interaction of the display 110 being touched by theinput device 200 is sensed, the controller 130 may control the display110 to display a UI that includes a plurality of menus for controllingthe user terminal device 100 to display a UI including a plurality ofmenus near the touched area of the display 110 according to the touchpattern of the touched surface of the plurality of surfaces of the inputdevice. Furthermore, when a user interaction of the input device beingdragged to one of the plurality of menus with the input device stilltouching the display is sensed, the controller 130 may perform afunction corresponding to the menu to which the input device wasdragged.

Referring to FIG. 6A, when a user interaction of the display 110 beingtouched by a first surface of the input device 200 is sensed, thecontroller 130, as illustrated in FIG. 6B, may control the display 110to display a UI including a plurality of menus 610 to 630 capable ofperforming a function corresponding to the first surface near thetouched area on the display 110. For example, when a user interaction ofthe display being touched by surface corresponding to the searchfunction is sensed, the controller may as illustrated in FIG. 6B,control the display 110 to display a human search menu 610, dictionarymenu 620 for searching word information, and internet search menu 630capable of searching related information from the internet on thesurrounding area of the touched surface on the display.

Referring to FIG. 6C, when a user interaction of the input device 200being dragged to the dictionary menu 620 of the plurality of menus withthe input device still touching the display is sensed, the controller130 may perform a function corresponding to the dictionary menu 620.More specifically, when a user command to select a certain word whilethe function of searching word information corresponding to thedictionary menu 620 is being activated, the controller may, asillustrated in FIG. 6D, control the display 110 to display thedictionary information 640 on the certain word selected.

According to another embodiment of the present disclosure, when a userinteraction is sensed of the input device being rotated while stillmaintaining a touch by the first surface of the input device on a firstitem among at least one items displayed on the display 110, thecontroller 130 may perform the function corresponding to the firstsurface regarding the first item.

Referring to FIG. 7A, when a user interaction is sensed of the thirditem 720 on the display being touched by the first surface(corresponding to the lock function) of the input device while aplurality of items 710 to 740 are being displayed on the display 110,and then the input device being rotated while maintaining the touch bythe first surface as illustrated in FIG. 7B, the controller 130 mayperform the lock function regarding the third item 730. In anotherexample, a user interaction is sensed of the input device 200 beingrotated while still maintaining the touch by the first surface of theinput device

According to another embodiment of the present disclosure, when a userinteraction is sensed of the second item 720 being touched by the secondsurface (corresponding to the delete function) of the input device whilethe plurality of items 710 to 740 are being displayed on the display 110and the input device 200 being rotated while maintaining the touch bythe first surface, the controller 130 may delete the second item 720.

According to another embodiment of the present disclosure, when a userinteraction is sensed of the input device 200 being turned around suchthat the surface touching the display is changed from the first surfaceto the second surface, the controller 130 may perform the functioncorresponding to the interaction of the input device 200 being turnedaround.

Referring to FIG. 8A, when a user interaction is sensed of the inputdevice 200 being turned around such that the surface touching thedisplay is changed from the first surface (corresponding to the datastoring function) to the second surface as illustrated in FIG. 8B withthe plurality of items 810 to 840 that correspond to a plurality ofphoto items being displayed on the display 110, the controller 130 mayactivate the data storage function that corresponds to the interactionof the input device 200 being turned around.

Herein, the controller may, as illustrated in FIG. 8C, control thedisplay 110 to display a GUI 850, 860 as if a box is being opened on thearea surrounding the touched area.

Furthermore, when a tap interaction of the second item 820 among theplurality of items being touched by the second surface is sensed, thecontroller 130 may store the photo content corresponding to the seconditem 820 where the tap interaction was sensed in the storage 160.Herein, when the photo content corresponding to the second item 820 isstored in the storage 160, the controller 130 may, as illustrated inFIG. 8E, control the display 110 to display a GUI as if the second item820 is being absorbed into the box. Then, when a tap interaction of thethird item 830 being tapped by the second surface of the input device200 is sensed, the controller 130 may control the display 110 to displaya GUI as if the photo content corresponding to the third item 830 wherethe tap interaction was sensed is being stored in the storage 160, andthe third item 830 is being absorbed into the box. Furthermore, when thedisplay 110 is touched by a surface other than the second surface of theinput device 200, the controller 130 may stop the data storing function.

According to another embodiment of the present disclosure, thecontroller 130 may perform various functions using the input device 200while a certain application is being executed. For example, thecontroller 130 may perform a controller function for performing a gameapplication as illustrated in FIG. 9 using the input device 200 whilethe game application is being executed. More specifically, while a gameapplication of breaking walls with a ball is being executed, when a ballhits the area touched by the input device 200, the controller 130 mayperform a function of rebounding the hit ball.

By another example, while a drawing application is being executed, thecontroller 130 may perform an eraser function of erasing a picture drawnusing the input device 200. More specifically, by touching the displaywith the first surface of the input device 200 and then dragging thetouch, the controller 130 may perform the erasing function.

According to another embodiment of the present disclosure, thecontroller 130 may control the communicator 140 to transmit variousitems to another user terminal device using the input device 200. Morespecifically, when a user interaction is sensed of an area of thedisplay 110 being touched by a surface corresponding to the data storingfunction of the input device 200 while a plurality of items 1110 to 1130are being displayed, the controller 130 may, as illustrated in FIG. 11A,control the display 110 to display a GUI 1140 as if a box is beingopened.

Furthermore, when a user interaction of dragging the second item 1120 toa touched area is sensed while the GUI 1140 is being displayed asillustrated in FIG. 11B, the controller 130 may store information on thesecond item 1120.

Furthermore, when a user interaction is sensed of the display of asecond user terminal device being touched by a surface corresponding tothe data storing function of the input device 200, wherein the seconduser terminal device is interlocked with the first user terminal device,the second user terminal device may, as illustrated in FIG. 12A, controlthe display 110 to display a GUI 1210 as if a box is being opened.

Furthermore, while the GUI 1210 is being displayed, when a flipinteraction of one area near the GUI 1210 being touched and then flippedtowards outside is sensed as illustrated in FIG. 12B, the second userterminal device may receive information on the second item 1120 from thefirst user terminal device, and as illustrated in FIG. 12B, control thedisplay 110 such that the second item 1120 may be taken out in thesensed flip direction. Herein, the information on the second item 1110may be received after the flip interaction is sensed in the second userterminal device, but without limitation, and thus, the information onthe second item 1110 may be received while the surface corresponding tothe data storing function of the input device 200 is touching the seconduser terminal device.

Referring to FIG. 13, when a user interaction is sensed of the inputdevice 200 being rotated with the touch by the first surface(corresponding to the volume adjusting function) of the input device 200on the first point of the display being maintained while the display 110shows a waiting screen, the controller 130 may adjust the volume of theuser terminal device 100 according to the interaction of the inputdevice 200 being rotated. For example, when a user interaction is sensedof the input device 200 being rotated in a counterclockwise directionwith the touch by the surface corresponding to the volume adjustingfunction of the input device 200 on the first point of the display 110being maintained while the display 110 shows a waiting screen, thecontroller 130 may reduce the volume of the user terminal device 100according to the extent of rotation of the rotation interaction.

According to another embodiment of the present disclosure, it ispossible to provide a network between user terminal devices that havebeen touched by a same surface of the input device 200.

More specifically, as illustrated in FIG. 14, when each of the first tofourth user terminal devices are touched by each of a plurality of inputdevices 200-1 to 200-4, each of the first to fourth user terminaldevices 100-1 to 100-4 may determine the touch pattern of the touchedsurface of each input device. For example, the first user terminaldevice 100-1 may determine that the touch on the first user terminaldevice 100-1 was made by the first surface of the first input device200-1, that the touch on the second user terminal device 100-2 was madeby the second surface of the second input device 200-2, that the touchon the third user terminal device 100-3 was made by the third surface ofthe third input device 200-3, and that the touch on the fourth userterminal device 100-4 was made by the fourth surface of the fourth inputdevice 200-4. Furthermore, each of the plurality of user terminaldevices 100-1 to 100-4 may share information on each of their touchedpatterns to create a network between the user terminal devices of whichthe same touch pattern has been touched. That is, a network may becreated between the first user terminal device 100-1 and the fourth userterminal device 100-4 of which the same first surface has been touchedamong the plurality of user terminal devices 100-1 to 100-4.

According to another embodiment of the present disclosure, thecontroller 130 may control the display 110 to display a plurality ofapplication items on an area surrounding the area touched by the inputdevice 170 using the input device 170.

More specifically, with the plurality of items 1510 to 1540 displayed asillustrated in FIG. 15A, when an interaction is sensed of the first item1510 being touched by the first surface (corresponding to the magnetfunction) of the input device 170, the controller 130 may, asillustrated in FIG. 15B, control the display 110 to display applicationitems 1550 to 1590 related to the first item 1510 on an area surroundingthe first item 1510.

Hereinafter, a control method of a user terminal device 100 will beexplained with reference to FIG. 16.

First of all, the user terminal device 100 senses a user interaction ofa touch being made by a polyhedral shaped input device that includesdifferent touch patterns on each of a plurality of surfaces at operationS1610. Herein, examples of user interactions include variousinteractions such as a tap interaction, drag interaction, rotatinginteraction, flip interaction, turn around interaction.

Furthermore, the user terminal device 100 performs a function of theuser terminal device 100 according to the touch pattern on the touchedsurface among the plurality of surfaces at operation S1620. Morespecifically, the user terminal device 100 may sense the touch patternon the touched surface of the input device, determine the touchedsurface based on the sensed touch pattern, and perform the functioncorresponding to the touched surface determined.

By doing this, the user terminal device 100 may not only perform variousmanipulations through an input device having a polyhedral shape but alsoprovide a new type of interaction where various fun elements may beadded.

Meanwhile, a control method according to the aforementioned variousembodiments of the present disclosure may be configured as a program andmay be provided through a display device. Furthermore, a non-transitorycomputer readable medium storing such a program may be provided. Anon-transitory computer readable medium refers to a computer readablemedium that may store data semi-permanently and not for just a shortperiod of time such as a register, cache, and memory. More particularly,the aforementioned various applications or programs may be stored in andprovided through a non-transitory computer readable medium such as acompact disc (CD), digital versatile disc (DVD), hard disk, blue raydisk, universal serial bus (USB), memory card, and read only memory(ROM) and the like.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device comprising: a touch screendisplay; and a processor configured to at least: control to displaycontent on the touch screen display, control to identify a surroundingarea of a hand manipulatable input device while the hand manipulatableinput device is placed over the touch screen display, control to, basedat least on the identified surrounding area, provide a plurality of menuitems on the identified surrounding area, wherein each of the pluralityof menu items respectively corresponds to a function for controlling theelectronic device, and control to, based on a drag of the handmanipulatable input device while the plurality of menu items isprovided, execute a function related to a menu item corresponding to adirection of the drag.
 2. The electronic device of claim 1, wherein theplurality of menu items comprise an item related to a search function.3. The electronic device of claim 1, wherein the touch screen display isa capacitive type touch screen display.
 4. A method executed by anelectronic device comprising a touch screen display, the methodcomprising: displaying content on the touch screen display; based atleast on a sensed predetermined touch pattern, identifying a surroundingarea of a hand manipulatable input device while the hand manipulatableinput device is placed over the touch screen display; based at least onthe identified surrounding area, providing a plurality of menu items onthe identified surrounding area, wherein each of the plurality of menuitems respectively corresponds to a function for controlling theelectronic device; and based on a drag of the hand manipulatable inputdevice while the plurality of menu items is provided, executing afunction related to a menu item corresponding to a direction of thedrag.
 5. The method of claim 4, wherein the plurality of menu itemscomprise an item related to a search function.
 6. The method of claim 4,wherein the touch screen display is a capacitive type touch screendisplay.
 7. A non-transitory computer readable recording medium storinginstructions executable by a processor of an electronic device to causethe processor to at least: displaying content on the touch screendisplay; identifying a surrounding area of a hand manipulatable inputdevice while the hand manipulatable input device is placed over thetouch screen display; based at least on the identified surrounding area,providing a plurality of menu items on the identified surrounding areaof the touch screen display, wherein each of the plurality of menu itemsrespectively corresponds to a function for controlling the electronicdevice; and based on a drag of the hand manipulatable input device whilethe plurality of menu items is provided, executing a function related toa menu item corresponding to a direction of the drag.
 8. Thenon-transitory computer readable recording medium of claim 7, whereinthe plurality of menu items comprise an item related to a searchfunction.
 9. The non-transitory computer readable recording medium ofclaim 7, wherein the touch screen display is a capacitive type touchscreen display.